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includes an ultrasound probe and both passive and active infrared tracking systems with position markers (16). 
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COMPUTER CONTROLLED GUIDANCE OF A BIOPSY NEEDLE 



Background of the Invention 



The present invention relates generally to interventional medicine, and 
particularly concerns properly locating, vectoring, and inserting a needle-like medical 
device toward and into a targeted patient anatomic feature while the patient is being 
imaged with single, or multi-modality medical imaging equipment such as computed 
tomography imaging (CTI) equipment, magnetic resonance imaging equipment 
(MRI), fluoroscopic imaging equipment, and 3D ultrasound equipment. 



Among others, Frank J. Bova and William A. Friedman of the present 
inventors have pioneered the art of high precision planning and treatment of 
intracranial targets using radiation originating from medical linear accelerators. All of 
these previously developed planning and treatment systems have been based upon a 
rigid model consisting of the patient's skull, upper dentisia and intracranial anatomy. 
Exemplary of these systems and methods are those described in U.S. patent 
application serial no. 09/621,868, filed July 21, 2000, and in the following U.S. Patent 
Nos., all issued to the Bova and Friedman on the indicated dates, assigned to the 
assignee of the present application, the entire contents and disclosures of all of which 
are incorporated herein by reference: 



5,954,647 Meu-ker system and related stereotactic procedure Sept. 21, 1999 

5,588,430 Repeat fixation for fi-ameless stereotactic procedure Dec. 31, 1996 

5,189,687 Apparatus for stereotactic radiosurgery Feb. 23, 1993 

5,027,818 Dosimetric technique for stereotactic radiosurgery July 02, 1991 

Although this rigid model is valid for cranial targets, it is not practical for all 
anatomic regions. An example of a target that cannot be modeled with a rigid body 
modality is metastatic diseeise within the liver. In order to effect the application of 
high precision biopsy, radiation treatments or other medical procedures to such 
deformable anatomic regions, real time imaging of the target region must be 
incorporated into the treatment procedure. 
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Multiplanar x-rays and ultrasoxind are the best suited of ail of the modalities 
available for such real time imaging. Multiplanar x-ray imaging, primarily orthogonal 
imaging, has been used to localize radiation targets for several decades. While this 
mode of target localization has several advantages, its primary disadvantages are the 
space and time it requires. The space required by the imaging chain, including x-ray 
source(s) and imaging electronics, is simply not available near or around a patient 
who is in position for real time treatment, especially if the treatment uses a medical 
linear accelerator. Depending on how fast an image of a given portion of the 
anatomy changes with time and the time required to complete a multiplanar x-ray 
process, the x-ray imaging may not be sufficiently fast to track changes and provide 
accurate real time data. 

U.S. Patent No. 5,893,832, issued to Song on June 24, 1997, describes an 
ultrasoxmd probe which provides a 3D image of an anatomic region without external 
probe movement. The probe effectively provides a 3D image of a selected anatomic 
region without the necessity for external probe movement. Ultrasound probes like 
those of the Song patent can provide real time imaging of a portion of the patient's 
anatomy, although the image data is with reference to the position of the ultrasound 
probe. As the ultrasound probe is moved, the point of reference changes. 

U.S. patent application serial no. 09/621,868, filed July 21, 2000 describes a 
system which enables image guidance during radiation therapy and surgery, by 
combining an ultrasound probe with both passive and active infi-ared tracking systems 
for production of a 3D image. The combined system enables a real time image 
display of the entire region of interest without probe movement. The system enables 
probe displacement during image acquisition so that all external displacements 
introduced by the probe can be accounted for at the time of placement of elements in 
support of a treatment protocol. This is accomplished by registration of a patient's 
real world anatomy with the patient's virtual world imaging study. The coordination 
of these two worlds allow for a clinician to perform a procedure in the virtual world 
and then, with the aid of computer guidance execute the procedure in the real world. 

The first application of linking the real world with the virtual world was the 
establishment of stereotactic neurological procedures based upon rigid stereotactic 
flames. Frameless virtual guidance technology has also been established for several 
operative environments. Intracranial procedures, based upon CTI and or MRI scans 
have been available for several years. The same CTI or MRI based guidance have 
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also been available for planning and guidance in spinal surgery. Recently, imaging 
support for the virtual environment has been extended to include virtual fluoroscopy. 
At the University of Florida the incorporation of both 2D and 3D ultrasound has now 
been made available for virtual procedures. This form of guidance is employed in 
many daily procedures including brain tumor biopsy, brain tumor resection, deep 
brain stimulation, pallidotomy for Parkinson's disease, lesioning procedures for pain, 
pedicle screw fixation, guidance for ENT surgical procedures, radiosurgery and 
stereotactic radiotherapy. 

What is needed, is the extension of this technology to image guidance during 
biopsy. It is desirable to reapply the tools used to project a virtual surgical, or 
radiation, tool to a biopsy needle. More particularly, it is desirable to apply CTI, 
MRI, fluoroscopy and ultrasound procedures, either independently or in combination, 
i.e., multi modality imaging, to guidance and placement of a biopsy needle. 

Summarv of the Invention 

The present invention is described in terms of two embodiments, the first of 
which is a computer controlled system for guiding a needle device, such as a biopsy 
needle, by reference to a single mode medical imaging system employing any one of 
computed tomography imaging (CTI) equipment, magnetic resonance imaging 
equipment (MRI), fluoroscopic virtual imaging equipment, or 3D ultrasound 
equipment. The second embodiment is a computer controlled system for guiding the 
needle device by reference to a multi-modal system, which includes any combination 
of the above-listed systems. 

In the first embodiment, the method of the present invention includes use of a 
needle device 3D image data set including 3D geometry of the needle device in 
conjunction with a data set obtained fi*om a single image system, wherein the needle 
device is configured to be carried by a needle device carrier. The needle device 
carrier is configured to move in orthogonal coordinate directions relative to a fixed 
frame of reference so that a current digital positional description of the needle device 
carrier can be identified with respect to the fixed frame of reference, which is with 
reference to the real world patient's position. 

A broad description of the first embodiment is directed to the steps of imaging 
at least a portion of a patient with an imaging device to provide a set of patient 
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imaging data, the set of patient imaging data having a fixed frame of reference 
relative to the patient, combining an image of the needle device with the set of patient 
imaging data to provide a combined image data set, calculating a desired combined 
image data set corresponding to a desired position of the needle device relative to the 
patient and the fixed frame of reference and causing relative movement between the 
patient and the needle device, based on the desired combined image data set, to bring 
the needle device position data set into registry with the desired position of the needle 
device. 

In a more detailed description of the first embodiment, the method includes 
the step of securing a plurality of patient position markers fixed relative to a patient, 
the patient position markers defining a fixed frame of reference. At least a part of the 
patient is imaged using an imaging device to provide a set of patient imaging data, 
the set of patient imaging data being relative to the fixed frame of reference. The set 
of patient imaging data includes positional data of the patient position markers when 
the patient position markers are image-conspicuous, and, alternatively, combined with 
telemetry fiduciary data when telemetry readouts are arranged to correspond to 
successive positions of a patient to be scanned. The set of patient imaging data is 3D 
data derived from 3D imaging systems, including virtual fluoroscopic and 3D. 
ultrasoimd imaging systems, as well as CTI and MRI imaging systems, and any other 
3D system to be developed. 

The current position description of the needle device carrier is identified with 
respect to the fixed frame of reference and a needle position data set is calculated with 
respect to the fixed frame of reference. A composite data set is calculated by 
combining the needle device 3D image data set and the 3D patient image data set, 
wherein the needle device' 3D image data set is adjusted with respect to the fixed 
frame of reference according to the needle position data set. The composite data set is 
determined from a selected set of co-ordinate locations defining a carrier guide path 
for movement of the needle device carrier with respect to the fixed frame of reference. 
The selected set of co-ordinate locations is s^^plied to the needle device carrier so that 
the needle device moves along a desired needle device guide path corresponding to 
the carrier guide path. 

As in the broad description of the first embodiment, the imaging device of the 
more detailed description is selected from a group of imaging devices including a 
computerized tomography imaging device, an magnetic resonance imaging device, a 
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fluoroscopic imaging device, and a 3D ultrasound imaging device that produces 3D 
imaging data without relative movement between the ultrasound imaging device and 
the patient. Additionally, the needle device is selected from a group of needle devices 
including a biopsy needle, a needle configured for injection of toxin into dise2ised 
tissue, and an instrument configured for precision placement of a screw, such as a 
pedicle screw, and the needle device 3D image data set is selected from a group of 3D 
image data sets including a biopsy needle 3D image data set, an injection needle 3D 
image data set, and an instrument 3D image data set. 

In one embodiment, the patient position markers are secured directly to the 
patient, and in a separate embodiment, the patent position markers are secured to the 
scanner table, which supports the patient. Alternatively, the patient position is 
determined by telemetry. 

In the second embodiment of the present invention, there is provided a method 
and system for properly locating, vectoring, and inserting a needle device toward and 
into a targeted patient anatomic feature, including imaging at least a portion of a 
patient with a first imaging technique to provide a first set of imaging data, the first 
set of imaging data having a fixed frame of reference. In one form of the second 
embodiment, a second set of imaging data is obtained by a second imaging technique 
to provide a second set of imaging data, preferably after the first imaging technique is 
complete. The data sets obtained from the two techniques are then combined to 
provide a composite data set. Advantageously, if the second imaging technique is 
both operatively faster and more conducive to the patient treatment environment than 
the first technique, but is less discriminating than the first imaging technique in terms 
of image detail, the application of the second imaging data set, as obtained on a 
substantially real time basis, can be used to update, and effectively determine, a 
desired selected view obtained from a stored data set from the more detailed first 
imaging technique. 

In a second form of the second embodiment of the present invention, after the 
above-described first set of imaging data has been obtained, at least a part of the 
patient is imaged with a second imaging technique which uses an ultrasound device to 
provide a second set of imaging data, the second set of imaging data being 3D data 
relative to the ultrasound device and not being fixed relative to the fixed frame of 
reference. The ultrasound device is operable to provide the 3D data without relative 
movement between the ultrasoimd device and the patient, as described in copending 
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U.S. patent application serial no. 09/621,868. Position data is determined for the 
ultrasound device. Using the determined position data and the second set of imaging 
data, a converted set of imaging data corresponding to the second set of imaging data 
being referenced to the fixed frame of reference is provided. The converted set of 
image data is combined with at least some of the furst set of imaging data to provide a 
first composite set of imaging data. An image of the needle device is provided. The 
image of the needle device is combined with the first composite set of image data to 
produce a second composite set of image data. 

In the second composite set of imaging data the position and orientation of the 
image of the needle device is identified relative to the image of the at least a portion 
of the patient and a desired position and orientation of the needle device image 
corresponding to a desired actual position and orientation of the needle device relative 
to the patient is determined therefirom. The relative movement between the patient 
and the needle device is caused to bring the needle device position data set into 
registry with the desired position and orientation of the needle device. 

The first imaging technique, as used to provide the first set of imaging data, is 
selected fit)m the group consisting of computerized tomography imaging, magnetic 
resonance imaging, and fluoroscopic imaging. In one method of the invention, the 
first imaging technique is performed and completed prior to the imaging with the 
ultrasound device. 

The step of imaging with the ultrasound device uses an ultrasound probe that 
produces 3D imaging data without relative movement between the ultrasonic probe 
and the patient. The step of determining position data for the ultrasound probe 
includes determining the position of a plurality of probe position markers on the 
ultrasound probe, the position of the probe position markers being determined by a 
technique not including the first and second imaging techniques. The position of the 
ultrasoimd probe is determined using infirared (IR) imaging 

In the course of a medical procedure employing the present invention, as 
applied to a patient, an image of the needle device is used in combination with the 
converted set of imaging data to achieve positioning of the needle device relative to 
the patient. The needle device is selected fi-om a group of needle devices including a 
biopsy needle, a needle configured for injection of toxin into diseased tissue, and an 
instrument configured for precision placement of a screw, and the needle device 3D 
image data set is selected firom a group of 3D image data sets including a biopsy 
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needle 3D image data set, an injection needle 3D image data set, and an instrument 
3D image data set. 

Relative movement is caused between the patient and the needle device to 
bring the second set of imaging data into registry vsdth the first set of imaging data. 
Altematively, the relative movement is accomplished by controlling the needle device 
with a robotic guidance apparatus. 

The method further includes the step of, at least before completion of the first 
imaging technique, securing a plurality of patient position markers fixed relative to 
the patient. Altematively, the patient position markers are secured to a scanner table 
for supporting the patient, or they are determined by telemetry or infrared (IR) 
imaging. 

The system of the first embodiment of the present invention provides 
computer controlled guidance of a needle device including a plurality of patient 
position markers operable for defining a fixed frame of reference relative to a patient, 
a needle device, a needle device 3D image data set including 3D geometry of the 
needle device, and a needle device carrier configured for carrying the needle device 
for relative movement between the patient and the needle device. 

The system also includes a 3D imaging system operable for imaging at least a 
part of the patient to provide a set of patient 3D imaging data, the set of patient 3D 
imaging data including positional data of the patient position markers representing a 
fixed frame of reference when the patient position markers are image-conspicuous, 
and combined with telemetry fiduciary data when telemetry readouts are arranged to 
correspond to successive positions of a patient to be scanned. A position determiner 
is provided for identifying a current position description of the needle device carrier 
with respect to the fixed frame of reference. A first processor is provided for 
calculating a needle position data set using the current position description, and a 
second processor is provided for calculating a composite data set by combining the 
patient 3D image data set and the needle device 3D image data set, wherein the 
needle device 3D image data set is adjusted with respect to the patient 3D image data 
set according to the needle position data set. A third processor is provided for 
calculating fi-om the composite data set a selected set of co-ordinate locations defining 
a carrier guide path for movement of the needle device carrier with respect to the 
fixed fi:'ame of reference so that the needle device moves along a desired needle 
device guide path corresponding to the carrier guide path. 
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The needle device is selected from a group of needle devices including a 
biopsy needle, a needle configured for injection of toxin into diseased tissue, and an 
instrument configured for precision placement of a screw, and the needle device 3D 
image data set is selected from a group of 3D image data sets including a biopsy 
needle 3D image data set, an injection needle 3D image data set, and an instrument 
3D image data set. 

The system of the second embodiment includes a plurality of patient position 
markers operable for fixing relative to a patient to define a fixed firame of reference, a 
needle device, a needle device 3D image data set including 3D geometry of the needle 
device, and a needle device carrier configured for carrying the needle device for 
relative movement between the patient and the needle device. 

The system also includes a non-ultrasonic 3D imaging subsystem operable for 
imaging at least a portion of the patient to provide a first patient 3D imaging data set, 
the first patient 3D imaging data set mcluding positional data of the patient position 
markers representing a fixed frame of reference when the patient position markers are 
image-conspicuous, and combined with telemetry fiduciary data when telemetry 
readouts are arranged to correspond to successive positions of a patient to be scanned. 

A 3D imaging subsystem operable is provided for imaging at least a part of the 
patient to provide a second patient 3D imaging data set, the part of the patient 
including at least some of the at least a portion of the patient, the 3D imaging 
subsystem being configured to use an ultrasound device to provide a second patient 
3D imaging data set, the second patient 3D imaging data set being 3D data relative to 
the ultrasound device and not being fixed relative to the fixed firame of reference, the 
ultrasound device being operable to provide the second patient 3D imaging data set 
without relative movement between the ultrasoimd device and the patient. 

A determiner is provided for determining position data for the ultrasound 
device, and a second processor is provided for using the determined position data and 
the second set of imaging data to calculate a converted set of imaging data 
corresponding to the second patient 3D imaging data set being referenced to the fixed 
frame of reference. A third processor is provided, the processor being operable for 
combining the converted set of image data with at least some of the first patient 3D 
imaging data set to provide a first composite imaging data set. 

Also included is a position determiner operable for determining a needle 
device actual position and orientation data set and a fourth processor is included, the 
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processor being operable for applying the determined needle device actual position 
and orientation data set to the needle device 3D image data set to form a result and for 
combining the result with the first composite imaging data set to produce a second 
composite image data set. The second composite image data set is configured for 
identification of the position and orientation of the needle device image relative to the 
first patient 3D imaging data set and determining therefrom a desired position and 
orientation of the needle device image corresponding to a desired actual position and 
orientation of the needle device relative to the patient. 

Relative movement can be caused between the patient and the needle device to 
bring the needle device position data set into registry with the desired position and 
orientation of the needle device, based on the determined desired position and 
orientation. 

As in the first embodiment, the needle device for the second embodiment is 
selected from a group of needle devices including a biopsy needle, a needle 
configured for injection of toxin into diseased tissue, and an instrument configured for 
precision placement of a screw, and the needle device 3D image data set is selected 
from a group of 3D image data sets including a biopsy needle 3D image data set, an 
injection needle 3D image data set, and an instrument 3D image data set. 

The non-ultrasonic 3D imaging subsystem is selected from the group 
consisting of a computerized tomography system, a magnetic resonance system, and a 
fluoroscopy system. The ultrasound device can be configured to include an 
ultrasound probe that produces 3D imaging data without relative movement between 
the ultrasound probe and the patient, and includes the ultrasound probe can include a 
plurality of probe position markers thereon. 

Optionally, the position determiner includes a subsystem to determine the 
position of the probe position markers and the patient position markers. Further, the 
system optionally includes an infrared (IR) camera. 

Brief Description of the Drawings 

The above and other features of the present invention will be more readily 
understood when the following detailed description is considered in conjunction with 
the accompanying drawings wherein like characters represent like parts throughout 
the several views and in which: 
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FIG. 1 is a simplified block diagram of the computer controlled system of the 

present 

invention shown in relationship to a simplified sectional side view of a patient P; 

FIG. 2 is a simplified block diagram of a second embodiment of the present 
invention shown in relationship to a simplified sectional side view of a patient P. 

Detailed Description 

« 

FIG. 1 is a simplified block diagram of the computer controlled system 10 of 
the present invention shown in relationship to a simplified sectional side view of a 
patient P. System 10 is for guiding a needle device, such as a biopsy needle, of the 
present invention, by reference to a single mode imaging system, which includes any 
one of computed tomography imaging (CTI) equipment, magnetic resonance imaging 
equipment (MRI), 3D ultrasound equipment, or virtual fluoroscopic imaging 
equipment. 

Patient P is shown on a table 12 and a position reference device 14 with a 
plurality of patient position markers 16 thereon. The reference device 14 is preferably 
secured directly to a stable (such as skeletal) part of the patient. The markers 16 are 
preferably passive (reflecting devices) or active devices which can be sensed with an 
infrared (IR) camera (shown in FIG. 2, discussed below). The markers and reference 
device can be constructed with IR reflectors, IR LEDs and various other components 
in a known way and are used to define a fixed frame of reference, as discussed in 
more detail in the various patents herein incorporated by reference. As illustrated, the 
device is secured to a bone of the patient. 

A needle device 18 attached to a. needle device carrier 20 configured for 
carrying needle device 18 for relative movement between patient P and the needle 
device 18. A manipulator arm 22, which may be either a robotic arm controlled by 
known methods or an manually manipulated arm, is operatively attached to needle 
carrier 20. 

A needle device 3D image data set 24 is stored in accordance with known data 
storage techniques and includes a digital depiction of the 3D geometry of the needle 
device 18. 

A 3D imaging system 26, which is operable for imaging at least a part of 
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patient P to provide a set of patient 3D imaging data 28. The set of patient 3D 
imaging data 28 includes positional data of the patient position maikers 16 
representing a fixed freme of reference when the patient position markers 16 are 
image-conspicuous, and can be combined with telemetry fiduciary data derived from 
a known telemetry system (not shown) when telemetry readouts are arranged to 
correspond to successive positions of a patient to be scanned. 

A position determiner 30 is provided for identifying a current position 
description of the needle device carrier 20 with respect to the fixed frame of 
reference. 

A first processor 32 is provided for calculating a needle position data set 34 
using the current position description, and a second processor 36 is provided for 
calculating a composite data set by combining the patient 3D image data set 38 and 
the needle device 3D image data set 24, wherein the needle device 3D image data set 
24 is adjusted with respect to the patient 3D image data set 28 according to the needle 
position data set 34. A third processor 40 is provided for calculating from the 
composite data set 38 a selected set of co-ordinate locations defining a carrier guide 
path for movement of the needle device carrier 20 with respect to the fixed frame of 
reference so that the needle device 18 moves along a desired needle device guide path 
corresponding to the carrier guide path. 

System 10 further includes a fourth processor 42 configured for enabling a 
user to bring the needle device position data set 34 into registry with the desired 
position and orientation of the needle device 18, as represented relative to the patient 
3D imaging data set 28, to produce a registry data set 44. An actuator 46 responsive 
to the registry data set 44 is attached to needle carrier 20 for relative movement 
between the patient P and the needle device 18. Altematively, actuator 46 and 
manipulator arm 22 can be the same apparatus. 

The needle device 18 is selected from a group of needle devices including a 
biopsy needle, a needle configured for injection of toxin into diseased tissue, and an 
instrument configured for precision placement of a screw, and the needle device 3D 
image data set is selected from a group of 3D image data sets including a biopsy 
needle 3D image data set 29, an injection needle 3D image data set 31, and an 
instrument 3D image data set 33. 

First processor 32, second processor 36, third processor 40, and fourth 
processor 42 are computational units which can be softweue or hardware modules 
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arranged separately or in any appropriate combination as part of a computer system 
47. Needle device 3D image data set 24, patient 3D imaging data set 28, needle 
position data set 34, composite data set 38, and registry data set 44 are data sets 48 
which reside on suitable data storage media and are configured for retrieval and 
update by computer system 47. Computer system 47 is operatively connected to 3D 
imaging system 64, position determiner 30, and manipulators 22 and 46, as 
appropriate and in accordance with known practices. 

FIG. 2 is a simplified block diagram of a computer controlled system 50 
shown in relationship to a simplified sectional side view of a patient P, and illustrating 
a second embodiment of the present invention, which includes a patient P disposed on 
a table 52, a position reference 54 associated with a plurality of patient position 
markers 56 operable for fixing relative to patient P to define a fixed frame of 
reference, a needle device 58, a needle device carrier 60 configured for carrying 
needle device 58 for relative movement between patient P and needle device 58, and a 
needle device 3D image data set 62 including 3D geometry of needle device 58. 
Optionally, needle device carrier 60 is actuated by a manipulator 59, which is a 
robotic arm or is operated manually. 

System 50 also includes first and second imaging subsystems, which can take 
the form of any combination of 3D imaging techniques. For illustrative purposes, the 
preferable combination of a 3D ultrasound imaging subsystem and any other 3D 
imaging subsystem will be described. In that arrangement, the first subsystem takes 
the form of a non-ultrasonic 3D imaging subsystem 64 operable for imaging at least a 
portion of patient P to provide a first patient 3D imaging data set 66. The first patient 
3D imaging data set 66 includes positional data of patient position markers 56 
representing a fixed firame of reference when the patient position markers 56 are 
image-conspicuous, and combined with telemetry fiduciary data when telemetry 
readouts are arranged to correspond to successive positions of a patient to be scanned. 
Non-ultrasonic 3D imaging subsystem 64 is generally similar to 3D imaging system 
26 described in connection with system 10, including operative connections with a 
first computer system 67, 

The second 3D imaging subsystem is subsystem 68, which is provided for 
imaging at least a part of patient P to provide a second patient 3D imaging data set 70 
representing a pari of patient P including at least some of the at least a portion of 
patient P. Although subsystem 68 can be any 3D imaging system, preferably, 3D 
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imaging subsystem 68 is comiected to a second computer system 76, including a 
second processor 77, and is configured to use a 3D ultrasound device 72 to provide 
the second patient 3D imaging data set 70, the second patient 3D imaging data set 70 
being 3D data relative to ultrasoimd device 72 and not being fixed relative to the fixed 
frame of reference. The ultrasound device 72 is operable to provide the second 
patient 3D imaging data set 70 without relative movement between the ultrasound 
device 72 and patient P, as described in copending U.S. patent application serial no. 
09/621,868, previously herein incorporated by reference. 

The ultrasound imaging data obtained fi-om the 3D ultrasound imaging 
subsystem 68 is converted to be relative to the fixed fi-ame of reference and is then 
combined into the imaging data obtained from the non-ultrasonic 3D imaging 
subsystem 64. The result of the combined data sets are used for targeting needle 
device S8 to the proper part of patient P. By combining the ultrasound data with the 
imaging data of subsystem 64 one obtains the value of real time ultrasound data in 
combination with the higher resolution of the earlier obtained non-ultrasound imaging 
data set. 

A probe position determiner 74 is provided for determining position data 100 
for the ultrasound device 72, and second processor 77 is provided for using the 
determined position data 100 and the second set of imaging data 70 to calculate a 
converted set of imaging data 78 corresponding to the second patient 3D imaging data 
set 70 being referenced to the fixed frame of reference. 

A third processor 80 is provided, processor 80 being operable for combining 
the converted set of image data 78 with at least some of the first patient 3D imaging 
data set 66 to provide a first composite imaging data set 82. 

Also included is a needle position determiner 84 operable for determining, for 
the needle device 58, a needle device actual position and orientation data set 86. 

A fourth processor 88 is operable for applying the determined needle device 
actual position and orientation data set 86 to needle device 3D image data set 62 to 
form a result and for combining the result with the first composite imaging data set 66 
to produce a second composite image data set 90. The second composite image data 
set 90 is configured for identification of the position and orientation of needle device 
image 62 as shown in the overall second composite image data set 90 and determining 
therefrom a desired position and orientation of the needle device image 92 
corresponding to a desired actual position and orientation of the needle device relative 
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to patient P. 

Relative movement is caused between patient P and needle device 58 to bring 
the needle device position data set 86 into registry with the desired position and 
orientation of the needle device 92, based on the determined desired position and 
orientation. 

As in the first embodiment, needle device 58 for the second embodiment is 
selected from a group of needle devices including a biopsy needle, a needle 
configured for injection of toxin into diseased tissue, and an instrument configured for 
precision placement of a screw, and the needle device 3D image data set is selected 
from a group of 3D image data sets including a biopsy needle 3D image data set 94, 
an injection needle 3D image data set 95, and an instrument 3D image data set 96. 

The non-ultrasonic 3D imaging subsystem 64 is selected from the group 
consisting of a computerized tomography system, a magnetic resonance system, and a 
fluoroscopy system. The ultrasound device 72 is configured to include an ultrasound 
probe 98 that produces 3D imaging data without relative movement between 
ultrasound probe 98 and patient P. Ultrasound probe 98 can include a plurality of 
probe position markers 102 thereon. Probe 102 provides 3D imaging data to 
processor 76. Reference device 54 is fixed to probe 102 and has probe position 
markers 56. Reference device 54 is similar in construction to device 14 of system 10 
and has markers 56 similar to markers 16. Reference device 54 differs from device 14 
in that device 54 may have fasteners (not shown) or otherwise be fixed to the probe 
102. 

Optionally, position determiner 74 includes a subsystem to determine the 
position of the probe position markers 102 and the patient position markers 56. 
Further, the system a tracking system, such as, for example an infrared (IR) camera 
104, which is connected to processor 76 and operatively tracks markers 56 and 102 
according to techniques described in copending U.S. patent application serial no. 
09/621,868, previously herein incorporated by reference. Other tracking systems are 
also suitable. 

A module 105 is provided to bring the needle device position data set 86 into 
registry with the desired position and orientation 92 of the needle device 58 to 
produce a registry data set 106 and a mechanism 108 responsive to the registry data 
set 106 and attached to the needle carrier 60 for relative movement between patient P 
and needle device 58. Actxiator 108 and manipulator 59 is the same automated device 
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for actuating needle device carrier 60. 

Second processor 77, third processor 80, and fourth processor 88 are 
computational units which are software or hardware modules arranged separately or 
in any appropriate combination as part of a computer system 76. Needle device 3D 
image data set 62, first patient 3D imaging data set 66, second patient 3D image data 
set 70, converted data set 78, needle position data set 86, first composite data set 82, 
second composite image data set 90, desired actual position and orientation of needle 
image data set 92, ultrasound determined position data set 100, and registry data set 
106, together with biopsy needle image data set 94, injection needle image data set 95 
and instrument 3D image data set 96, are stored in data storage system 110 and are 
configured for retrieval and update by computer systems 67 and 76. Computer system 
67 is operatively connected to 3D imaging system 64, position determiner 84, and 
manipulators 59 and 108. Computer system 76 is operatively connected to second 3D 
imaging system 68, probe position determiner 74, probe 98, and infirared camera 
system 104, as appropriate and in accordance with known practices. 

The operation of the method of the present invention will now be discussed in 
the context of each 3D imaging technology. For each 3D imaging procedure, the 
ability to register the imaging modality to the patient's real world position is an 
absolute requirement before a needle carrier path can be defined. The use of multi 
modality imaging, through the use of image registration technology, requires only one 
image data set derived fix>m one image subsystem to be registered between the real 
and virtual worlds, while all other image data sets derived firom other imaging 
subsystems are then registered to that data set. An example of this technique is the 
ability to plan a stereotactic biopsy based upon a stereotactic CTI scan and an MRI 
scan which is not stereotactically taken but registered ematomically to the CTI scan. 

Each imaging modality has unique physical characteristics that require unique 
solutions in order to provide the real world to virtual world linkage. Any combination 
of these technologies can be co-registered, once their respective data sets are placed in 
the virtual world. For ease of description, the image acquisition, registration, and 
application to guidance of a needle device, such as a biopsy needle, will be separately 
discussed next in connection with each imaging technology. 

Computer Tomography Imaging (CTI) Biopsy Subsystem: 

The CTI based approach to locating, vectoring, and inserting a needle-like 
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medical device toward, and into, a targeted patient anatomic feature requires that each 
individual CTI image, or CT slice, be registered to the patient. This in turn requires 
the definition of CTI room space and patient space and the ability to track one relative 
to the other. The definition of this space is through a stereotactic fiducial system 
incorporated into the scanner table, a reference attached to part of the patient's 
support-immobilization system, or, altematively, it is through scanner telemetry 
readouts. In either situation, each pixel of CTI data is mapped into virtual space and 
becomes part of the patient's virtual image. When the patient is withdrawn from the 
scanner gantry, the telemetry system tracks the rigid body move, thereby keeping the 
patient's virtual data set registration to the patient. Simultaneously, the biopsy needle 
is introduced to the real world and is tracked in the virtual world through a six-degree 
of freedom tracking system. This tracking is accomplished through one of a variety 
of tracking technologies, such as, for example, optical tracking, as in the case of either 
active or passive infrared tracking systems, or magnetically tracking via an articulated 
arm system. 

Prior to performance of the biopsy medical procedure, the biopsy needle is 
calibrated so that the needle geometry of the biopsy needle is known to the system 
and is accurately inserted into the virtual world model. Any movement of the biopsy 
needle in the real world is mirrored in the virtual world. This allows the clinician to 
plan a trajectory in the virtual world, in a manner similar to virtual surgical planning, 
and then guide the real world biopsy needle along this planned trajectory. To assist in 
the alignment of the biopsy several displays are provided to help align the needle in 
all size degrees of freedom. This alignment assistance is in the form of freehand 
guidance or is used to control a robotic guidance apparatus. In this later case the 
required needle movements are decoupled from the scanner room coordinate system 
and re-coupled to the robotic guidance coordinate system. This is similar to the 
decoupling that is provided in a radio camera system, wherein decoupling allows 
feedback to be aligned with the available linear accelerator table controls that rotate in 
room space, as the patient is setup. 

To assist in the alignment and stabilization of the patient beginning with the 
scanning and continuing through the biopsy process it may be advantageous to 
provide a system that incorporates both a stereotactic fiducial system and an 
immobilization system. Several such systems are commercially available and in the 
development process the strengths and weaknesses of each should be considered. 
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Magnetic Resonance Imaging (MRI) Biopsy Subystem 

According to the present invention, alternatively, an MRI biopsy system is 
made to function in a manner directly parallel to the above-described CTI system. 
Known software image registration techniques are used to combine the MRI and CTI 
image data sets to allow for both to be simultaneously available when planning in the 
virtual world. 

Fluoroscopic Biopsy Subsystem: 

A standalone fluoroscopic biopsy system configured to develop a virtual 
image is applied to locating, vectoring, and inserting a needle-like medical device 
toward, and into, a targeted patient anatomic feature resembles known systems used 
for virtual fluoroscopic navigation for spinal surgery. In the present invention, the x- 
ray source and the image intensifier are both fitted with fiducials that are tracked. A 
reference system is rigidly attached to the patient's anatomy, and in the application to 
spinal surgery, it usually is attached to a specific vertebra, creating a real world 
patient coordinate system. The geometry of all fluoroscopic views taken are known 
relative to the specific patient's reference coordinate system. 

Once a set of fluoroscopic views that are sufficient for the clinician to 
appreciate when an acceptable aligiunent has been achieved, the fluoroscopic source 
is no longer used. A biopsy needle, with a known geometry and calibration, is 
introduced into the real world and mathematically inserted into the corresponding pre- 
recorded fluoroscopic views in the virtual world. While this system does not have the 
ability to present the clinician with a true 3D description of the patients anatomy, as 
would be provided if a CTI or MRI model, it does allow for a significant reduction in 
x-ray exposure to the patient and operating room personnel and also allows for 
multiple simultaneous virtual real time fluoroscopic view to be evaluated, eliminating 
the need to hold the needle's position while the fluoroscopic system is realigned. 

As with the CT described above, the fluoroscopic system is made to function 
via a freehand guidance interface or through a robotic interface, with known coupling 
of a biopsy needle carrier attached to the biopsy needle with a robotic control system. 
This system can also be jointly coupled to a CTI biopsy needle guidance system. This 
is accomplished through a rigid relationship between the CTI room reference system 
and the fluoroscopic patient reference system. In the, combined system both the plane 
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film fluoroscopic views as well as the true 3D anatomy are appreciated in the virtual 
world planning system. 

Ultrasound Biopsy Subsystem: 

An image from a 3D ultrasound system is obtained, transferred to a 
workstation, and then mapped into both room space and virtual room space. The 
room space is provided through any imaging source, such as a CTI or MRI imaging 
system. It is assumed that the patient and the room space form a rigid body system, 
i.e., the room reference system moves with the patient. With the image in virtual 
space, a biopsy probe, equipped with tracking, is introduced into room space and 
simultaneously displayed in virtual space. With the tracking of the probe the clinician 
is able to appreciate the orientation and trajectory of the biopsy probe in six degrees 
of freedom, relative to the anatomy that is being ultrasonically imaged. Although the 
assumption of a rigid body arrangement has been made, this assumption is modified if 
the interface between the ultrasound system and the workstation is sufficiently fast as 
to allow for the instantaneous update oif the virtual image. 

Although specific constructions have been presented, it is to be imderstood 
that these are for illustrative purposes only. Various modifications and adaptations 
will be apparent to those of skill in the art. Therefore, the scope of the present 
invention should be determined by reference to the claims. 
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What is claimed is 



1 1 . A method for computer controlled guidance of a needle device configured 

2 to move in orthogonal coordinate directions relative to a fixed firame of reference in 

3 combination with a 3D imaging device, the method comprising the steps of: 

4 imaging at least a portion of a patient with the imaging device to provide a set 

5 of patient imaging data, the set of patient imaging data having a fixed frame of 

6 reference relative to the patient; 

7 combining an image of the needle device with the set of patient imaging data 

8 to provide a combined image data set; 

9 calculating a desired combined image data set corresponding to a desired 

10 position of the needle device relative to the patient and the fixed firame of reference; 

11 and 

12 causing relative movement between the patient and the needle device, based 

13 on the desired combined image data set, to bring the needle device position data set 

14 into registry with the desired position of the needle device. 

* 

1 2. The method of Claim 1 wherein the needle device is selected fi-om a group 

2 of needle devices including a biopsy needle, a needle configured for injection of toxin 

3 into diseased tissue, and an instrument configured for precision placement of a screw, 

4 and the needle device 3D image data set is selected from a group of 3D image data 

5 sets including a biopsy needle 3D image data set, an injection needle 3D image data 

6 set, and an instrument 3D image data set. 

1 3. The method of Claim 2 wherein causing relative movement between the 

2 patient and the needle device is accomplished by controlling the needle device with a 

3 robotic guidance apparatus. 

1 4. A method for computer controlled guidance of a needle device using a 

2 needle device 3D image data set including 3D geometry of a needle device, the needle 

3 device being configured to be carried by a needle device carrier, the needle device 

4 carrier being configured to move in orthogonal coordinate directions relative to a 

5 fixed firame of reference so that a current digital positional description of the needle 
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6 device carrier with respect to the fixed frame of reference can be identified, the 

7 method comprising the steps of: 

8 securing a plurality of patient position markers fixed relative to a patient, the 

9 patient position markers defining the fixed frame of reference relative to the patient; 

10 imaging at least a part of the patient using an imaging device to provide a set 

11 of patient imaging data, the set of patient imaging data being relative to the fixed 

12 frame of reference, the set of patient imaging data including positional data of the 

13 patient position markers when the patient position markers are image-conspicuous, 

14 and combined with telemetry fiduciary data when telemetry readouts are arranged to 

1 5 correspond to successive positions of a patient to be scanned; 

1 6 identifying the current position description of the needle device carrier with 

17 respect to the fixed frame of reference and calculating a needle position data set with 

1 8 respect to the fixed frame of reference; 

19 calculating a composite data set by combining the needle device 3D image 

20 data set and the patient image data set, wherein the needle device 3D image data set is 

21 adjusted with respect to the fixed firame of reference according to the needle position 

22 data set; and 

23 determining from the composite data set a selected set of co-ordinate locations 

24 defining a carrier guide path for movement of the needle device carrier with respect to 

25 the fixed frame of reference. 

1 S. The method of claim 4 fiirther comprising the step of applying the selected 

2 set of co-ordinate locations to the needle device carrier so that the needle device 

3 moves along a desired needle device guide path corresponding to the carrier guide 

4 path. 

1 6. The method of Claim 4 wherein the imaging device is selected from a 

2 group of imaging devices including a computerized tomography imaging device, an 

3 magnetic resonance imaging device, a fluoroscopic imaging device, or a 3D 

4 ultrasound imaging device that produces 3D imaging data without relative movement 

5 between the ultrasound imaging device and the patient. 
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6 7. The method of Claim 4, further comprising the step of causing relative 

7 movement between the patient and the needle device to bring the needle device 

8 position data set into registry with the determined desired position and orientation of 

9 the needle device. 

1 8. The method of Claim 4, wherein the patient position markers are selected 

2 from a group of markers consisting of patient markers configured to be secured to a 

3 scanner table for supporting the patient and patient position markers configured to be 

4 secured directly to the patient. 

1 9. The method of Claim 4, wherein the needle device is selected from a group 

2 of needle devices including a biopsy needle, a needle configured for injection of toxin 

3 into diseased tissue, and an instrument configured for precision placement of a screw, 

4 and the needle device 3D image data set is selected from a group of 3D image data 

5 sets including a biopsy needle 3D image data set, an injection needle 3D image data 

6 set, and an instrument 3D image data set. 

1 10. A method for computer controlled guidance of a needle device configured 

2 to move in orthogonal coordinate directions relative to a fixed firame of reference, the 

3 method comprising the steps of: 

4 imaging at least a portion of a patient with a first imaging technique to provide 

5 a first set of imaging data, the first set of imaging data having a fixed frame of 

6 reference relative to the patient; 

7 imaging at least a part of the patient with a second imaging technique to 

8 provide a second set of imaging data, the part of the patient including at least some of 

9 the at least a portion of the patient, the second imaging technique being different than 

10 the first imaging technique, the second set of imaging data being data not necessarily 

1 1 being fixed relative to the fixed frame of reference; 

12 registering the second imaging data set with the first imaging data set to 

1 3 provide a first composite set of imaging data; 

14 providing an image data set of the needle device; 

15 combining the image data set of the needle device with the first composite set 

16 of image data to produce a second composite set of image data; and 
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17 identifying in the second composite set of imaging data the position and 

1 8 orientation of the image of the needle device relative to the image of the at least a 

19 portion of the patient and determining therefrom a desired position and orientation of 

20 the needle device image corresponding to a desired actual position and orientation of 

21 the needle device relative to the patient. 

1 11. The method of Claim 10, further comprising the step of causing relative 

2 movement between the patient and the needle device to bring the needle device 

3 position data set into registry with the determined desired position and orientation of 

4 the needle device. 

1 12. The method of Claim 10 wherein the first imaging technique is selected 

2 from a group consisting of computerized tomography imaging, magnetic resonance 

3 imaging, and fluoroscopic imaging and the second imaging technique is a 3D 

4 ultrasound imaging technique, wherein the fu^t imaging technique is performed and 

5 completed prior to commencement of the second imaging technique. 

1 13. The method of Claim 10, wherein the needle device is selected from a 

2 group of needle devices including a biopsy needle, a needle configured for injection 

3 of toxin into diseased tissue, and an instrument configured for precision placement of 

4 a screw, and the needle device 3D image data set is selected from a group of 3D . 

5 image data sets including a biopsy needle 3D image data set, an injection needle 3D 

6 image data set, and an instrument 3D image data set. 

1 14. A method for coniputer controlled guidance of a needle device 

2 configured to move in orthogonal coordinate directions relative to a fixed frame of 

3 reference, the method comprising the steps of: 

4 imaging at least a portion of a patient with a first imaging technique to provide 

5 a first set of imaging data, the first set of imaging data having a fixed frame of 

6 reference; 

7 imaging at least a part of the patient with a second imaging technique to 

8 provide a second set of imaging data, the part of the patient including at least some of 

9 the portion of the patient, the second imaging technique using an ultrasound device to 
10 provide a second set of imaging data, the second set of imaging data being 3D data 
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1 1 relative to the ultrasound device and not being fixed relative to the fixed frame of 

12 reference, the ultrasound device being operable to provide the second set of imaging 

13 data without relative movement between the ultrasound device and the patient, 

14 wherein the first set of imaging data is obtained prior to acquisition of the second set 

15 of imaging data; 

16 determining position data for the ultrasound device; 

17 using the determined position data and the second set of imaging data to 

18 provide a converted set of imaging data corresponding to the second set of imaging 

19 data being referenced to the fixed frame of reference; 

20 combining the converted set of image data with at least some of the first set of 

21 imaging data to provide a first composite set of imaging data; 

22 providing an image data set of the needle device; 

23 combining the image data set of the needle device with the first composite set 

24 of image data to produce a second composite set of image data; and 

25 identifying in the second composite set of imaging data the position and 

26 orientation of the image of the needle device relative to the image of the at least a 

27 portion of the patient and determining therefrom a desired position and orientation of 

28 the needle device image corresponding to a desired actual position and orientation of 

29 the needle device relative to the patient. 

1 15. The method of Claim 14, further comprising the step of causing relative 

2 movement between the patient and the needle device to bring the needle device 

3 position data set into registry with the determined desired position and orientation of 

4 the needle device. 

1 16. The method of Claim 14 wherein the step of determining position data for 

2 the ultrasound probe includes determining the position of a plurality of probe 

3 position markers on the ultrasound probe, the position of the probe position markers 

4 being determined by a technique not including the first and second imaging 

5 techniques. 



1 

2 



17. The method of Claim 14 wherein the position of the ultrasoimd probe is 
determined using infrared (IR) imaging. 
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1 18. The method of Claim 14 fiuther comprising the step of, at least before 

2 completion of the first imaging technique, securing a plurality of patient position 

3 markers fixed relative to the patient. 

1 19. The method of Claim 14, wherein the needle device is selected from a 

2 group of needle devices including a biopsy needle, a needle configured for injection 

3 of toxin into diseased tissue, and an instrument configured for precision placement of 

4 a screw, and the needle device 3D image data set is selected fi*om a group of 3D 

5 image data sets including a biopsy needle 3D image data set, an injection needle 3D 

6 image data set, and an instrument 3D image data set. 

1 20. A system for computer controlled guidance of a needle device 

2 comprising: 

3 a needle device 3D image data set including 3D geometry of the needle 

4 device; 

5 an imaging system operable for imaging at least a part of the patient to provide 

6 a set of patient imaging data, the set of patient imaging data having a fixed frame of 

7 reference relative to the patient; 

8 a first processor configured for combining the needle device 3D image data set 

9 with the set of patient imaging data to provide a combined image data set; and 

1 0 a second processor configured for calculating a desired combined image data 

1 1 set corresponding to a desired position of the needle device relative to the patient and 

12 the fixed fi:ame of reference wherein the desired combined image data set is available 

1 3 to cause relative movement between the patient and the needle device to move the 

14 needle device to the desired position. 

1 21. A system for computer controlled guidance of a needle device carried by 

2 a needle device carrier configured for causing relative movement between a patient 

3 and the needle device comprising: 

4 a plurality of patient position markers operable for fixing relative to the patient 

5 to define a fixed fi-ame of reference; 

6 a needle device 3D image data set including 3D geometry of the needle 

7 device; 
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8 an imaging system operable for imaging at least a part of the patient to provide 

9 a set of patient imaging data, the set of patient imaging data including positional data 

10 of the patient position markers representing a fixed frame of reference when the 

1 1 patient position markers are image-conspicuous, and combined with telemetry 

12 fiduciary data when telemetry readouts are arranged to correspond to successive 

1 3 positions of a patient to be scanned; 

14 a position determiner for identifying a current position description of the 

15 needle device carrier with respect to the fixed frame of reference; 

16 a first processor for calculating a needle position data set using the current 

1 7 position description; 

18 a second processor for calculating a composite data set by combining the 

19 patient image data set and the needle device 3D image data set, wherein the needle 

20 device 3D image data set is adjusted with respect to the patient image data set 

21 according to the needle position data set; and 

22 a third processor for calculating from the composite data set a selected set of 

23 co-ordinate locations defining a carrier guide path for movement of the needle device 

24 carrier with respect to the fixed frame of reference so that the needle device moves 

25 along a desired needle device guide path corresponding to the carrier guide path. 



1 22. The system of Claim 21 further comprising a module to bring the needle 

2 device position data set into registry with the desired position and orientation of the 

3 needle device to produce a registry data set and a mechanism responsive to the 

4 registry data set, the mechanism being operatively attached to the needle carrier to 

5 cause relative movement between the patient and the needle device. 



1 23. The system of Claim 21 wherein the needle device is selected from a 

2 group of needle devices including a biopsy needle, a needle confrgured for injection 

3 of toxin into diseased tissue, and an instrument configured for precision placement of 

4 a screw, and the needle device 3D image data set is selected from a group of 3D 

5 image data sets including a biopsy needle 3D image data set, an injection needle 3D 

6 image data set, and an instrument 3D image data set. 
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1 24. A system for computer controlled guidance of a needle device carried by 

2 a needle device carrier configured for causing relative movement between a patient 

3 and the needle device comprising: 

4 a plurality of patient position markers operable for fixing relative to a patient 

5 to define a fixed frame of reference; 

6 a needle device 3D image data set including 3D geometry of the needle 

7 device; 

8 a non-ultrasonic imaging subsystem operable for imaging at least a portion of 

9 the patient to provide a first patient imaging data set, the first patient imaging data set 

10 including positional data of the patient position markers representing a fixed frame of 

11 reference when the patient position markers are image-conspicuous, and combined 

12 with telemetry fiduciary data when telemetry readouts are arranged to correspond to 

13 successive positions of a patient to be scarmed; 

14 an imaging subsystem operable for imaging at least a part of the patient to 

15 provide a second patient imaging data set, the part of the patient including at least 

16 some of the at least a portion of the patient, the imaging subsystem being configwed 

17 to use an ultrasound device to provide a second patient imaging data set, the 

18 ultrasound device including an ultrasound probe that produces 3D imaging data 

19 without relative movement between the ultrasound probe and the patient, the second 

20 patient imaging data set being relative to the ultrasound device and not being fixed 

21 relative to the fixed frame of reference, the ultrasound device being operable to 

22 provide the second patient imaging data set without relative movement between the 

23 ultrasound device and the patient; 

24 a probe position determiner for determining position data for the ultrasound 

25 device; 

26 a second processor operable for using the determined position data and the 

27 second set of imaging data to calculate a converted set of imaging data corresponding 

28 to the second patient imaging data set being referenced to the fixed frame of 

29 reference; 

30 a third processor operable for combining the converted set of image data with 

31 at least some of the first patient imaging data set to provide a first composite imaging 

32 data set; 

33 a position determiner operable for determining a needle device actual position 

34 and orientation data set; and 
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a fourth processor operable for applying the determined needle device actual 
position and orientation data set to the needle device 3D image data set and the first 
composite imaging data set to produce a second composite image data set, the second 
composite image data set being configured for identification of a position and 
orientation of the needle device image and determining therefrom a desired position 
and orientation of the needle device image corresponding to a desired actual position 
and orientation of the needle device relative to the patient. 

25. The system of Claim 24 further comprising a module to bring the needle 
device position data set into registry with the desired position and orientation of the 
needle device to produce a registry data set and an actuator responsive to the registry 
data set and operatively attached to the needle carrier for relative movement between 
the patient and the needle device. 

26. The system of Claim 24 wherein the needle device is selected from a 
group of needle devices including a biopsy needle, a needle configured for injection 
of toxin into diseased tissue, and an instrument configured for precision placement of 
a screw, and the needle device 3D image data set is selected from a group of 3D 
image data sets including a biopsy needle 3D image data set, an injection needle 3D 
image data set, and an instrument 3D image data set. 

27. The system of Claim 24 wherein the non-ultrasonic imaging subsystem is 
selected from the group consisting of a computerized tomography system, a magnetic 
resonance system, and a fluoroscopy system. 

28. The system of Claim 24 frirther comprising a plurality of probe position 
markers on the ultrasound probe. 

29. The system of Claim 24 wherein the position determiner includes a 
subsystem to determine the position of the probe position markers and the patient 
position markers. 
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